System, server and data capture device for roadside asset tracking and maintenance monitoring

ABSTRACT

There is provided herein an apparatus and method for roadside asset tracking and maintenance monitoring having a mobile unit with data capture devices for capturing roadside asset imagery, global positioning system (GPS) receivers and data interfaces for communicating with an asset management server. As such, the apparatus may take roadside imagery for automated asset identification which may include utilising an asset type image recognition technique for automating the identification of the roadside assets.

FIELD OF THE INVENTION

The present invention relates in particular, but not necessarilyentirely, to a system, server and data capture device for roadside assettracking and maintenance monitoring.

BACKGROUND

Roadside assets, such as public infrastructure assets, such as speedmanagement posts, reflector posts, roadside barriers and the like areinstalled and subsequently repaired and maintained over long periods oftime.

Now, D1 (US 20080086391 A1—MAYNARD), being exemplary of the currentstate of the art, discloses a system for impromptu asset tracking formaintenance scheduling. Specifically, D1 refers to the tracking ofmovable asset types such as graders, levelers, dozers, saws, debristransportation vehicles, diggers, pavers, concrete trucks, supplytrucks, cranes, tools, service trucks, compressors and so on anddescribes examples of the system used in the construction industry(specifically building a shopping mall) for monitoring asset maintenanceand unauthorised use of such assets.

For example, D1, in paragraphs 481-482 refers to a reporting device thatis mounted to a moveable asset so as to record characteristics of themoveable asset such as by, for example, recording the position of themoveable asset, and having a diagnostic evaluator such as a mileageindicator, a speedometer, a tachometer, an oil pressure indicator, awheel pressure indicator, a hydraulic indicator, an engine time monitor,and the like to monitor and diagnose the asset so as to be able toschedule maintenance and detect unauthorised use of the moveable asset.

As such, D1 is not suited for fixed roadside asset. In this regard, forroadside assets, councils often times have poor documentation of suchroadside asset installations and may therefore not have informationrelating to the specific location, type, condition and value of eachroadside asset.

As such, it would be advantageous to have the ability to identifyroadside asset installations.

In this regard, the best D1 offers in terms of identifying (moveable)assets is by scanning a barcode, or inputting a chassis VIN number orthe like (see paragraph 488 of D1).

However, D1 is not suited for identifying roadside assets becauseroadside assets do not uniformly comprise such barcodes, VIN numbers andthe like.

As such, it would be advantageous to have the ability to automate theidentification of roadside assets in a manner that does not rely onbarcodes and the like.

Furthermore, councils may not be aware of roadside assets that have beenremoved and require replacement or that have been damaged and requiremaintenance.

As such, it would be advantageous to have the ability to automate thedetection of missing roadside assets.

Furthermore, if an asset is to be replaced, such as a speed limitmanagement post, the specific speed limit management post may requireinstallation at a particular location adjacent the road and specify aparticular speed. In this manner, the council may not know thepreviously utilised specific location or the specific speed limitdisplayed by the speed limit management post. As such, were the speedlimit management post replaced, it may be installed in the incorrectlocation, or with the incorrect speed limit.

As such, it would be advantageous to have a historical record ofinstalled roadside assets, including their characteristics, such as, forexample for speed management signs, their locations, their respectivespeed limits and the like.

Furthermore, councils have no quality control mechanisms for roadsidemaintenance, such as verge grass cutting other than manual inspections.For example, at least five times a year, the council may deploy grasscutters to cut grass adjacent roads which may involve multiple cuttersat differing times. However, councils are unable to control the qualityof the grass cutting, such as whether the grass has been cut, whetherthe grass has been cut to the correct height, whether the grass has beencut sufficiently proximate roadside assets and the like. Indeed, theonly mechanism for councils to ensure quality is by way of manualinspection which is not feasible.

As such, it would be advantageous to have means for monitoring thequality of roadside maintenance.

Furthermore, many councils across Australia are experiencing a backlogof infrastructure renewal and there have been recommendations for thefunding of asset management programs for councils. In this regard,councils need to allocate funding for roadside asset maintenance so asto request funding from the federal government, allocate rates and thelike. However, councils often times do not know the extent of theirasset inventory, or the value of the assets of their inventory. In thismanner, councils cannot accurately calculate depreciation costs,replacement costs and the like.

D2 (US 20080086391 A1—MAYNARD) discloses a system that receives fixedasset data and then predicts a maintenance plan based on variousstatistical factors, such as weather, asset type failure rates and thelike.

As such, D2 fails to offer the above described advantages of the abilityto identify roadside asset installations, the ability to automate theidentification of roadside assets in a manner that does not rely onbarcodes and the like, the ability to automate the detection of missingroadside assets, the ability to have a historical record of installedroadside assets, including their characteristics, such as, for examplefor speed management signs, their locations, their respective speedlimits and the like.

It is to be understood that, if any prior art information is referred toherein, such reference does not constitute an admission that theinformation forms part of the common general knowledge in the art, inAustralia or any other country.

SUMMARY OF THE DISCLOSURE

The present invention seeks to provide a method, system, server and datacapture device for roadside asset tracking and maintenance monitoring,which will overcome or substantially ameliorate at least some of thedeficiencies of the above prior art, or to at least provide analternative. Specifically, in embodiments as will be described infurther detail below, there is described an asset and maintenancetracking system which may be deployed on roadside maintenance vehicles,such as grass cutters, to record roadside assets, such as trafficmanagement post, reflector posts and the like, subsequently monitor thepreviously recorded assets, and to monitor the maintenance conducted bythe roadside maintenance vehicle.

Specifically, in accordance with particular embodiments and theexemplary application of roadside grass cutting, the system may be runin “Set-up” mode such that each roadside management post that is slashedis recorded, coded and labelled on a map. A image of the asset is takenat the time of grass cutting that is stored for reference should it needto be specifically identified.

Furthermore, the system may perform asset identification and valuationwherein once data is entered, the system will provide a data analysisoption where each asset image is analysed for type, condition andvaluation at the time of entry. Any asset needing attention will beflagged and given a liability risk rating.

The system may also allow for real-time tracking of maintenancemachinery enabling real-time feedback of the progress of the roadsidemaintenance. A GPS tracking system allows councils and supervisors tosee the location of the grass cutting maintenance machinery on a map andprovide more information such as the operator of the machinery.

The system may be further adapted to provide a photographic summary ofeach maintenance job wherein front and rear mounted cameras will becapable of time incremented photographs showing each maintenance run'sworks as executed (WAE) and work in progress (WIP). A time-lapse videoof these photos will give supervisors an overview of each job, data forquality control and efficiency reviews as well as contract compliancedata.

The system may further allow for accumulative data wherein the systemwill create a log for each maintenance run that will provide usefulinformation that can be used for future statistical analysis andbudgeting forecasts.

The system may further allow for real-time incident reporting whereinany incidents encountered in the maintenance run will be recorded andflagged for council or a supervisor's attention immediately reducing therisk of escalation of any incidents.

The system may further allow for collaborative data wherein data frommultiple councils can be collected and compared. This will encourage anincrease in efficiency, best practice, budget comparison and providecomparative statistics.

With the foregoing in mind, according to one aspect, there is providedmethod for roadside asset tracking and maintenance monitoring, themethod comprising: periodically deploying a mobile unit alongside aroadside section, the mobile unit comprising a data capture devicecomprising: an asset data capture device operably coupled to at leastone digital camera configured for capturing roadside asset image data; aglobal positioning system (GPS) receiver; and a data interface forcommunicating with an asset management server, the server comprising anasset tracking register database; receiving the roadside asset imagedata representing images taken of a plurality of roadside assets;receiving location data from the GPS receiver representing therespective locations the roadside assets; utilising an asset type imagerecognition technique for automating the identification of the roadsideassets; comparing roadside asset data of the asset tracking registerdatabase to: record newly identified roadside assets and theirrespective locations in the asset tracking register database; andidentify missing roadside assets.

The asset type image recognition technique may comprise an imagerecognition stage comprising edge shape detection.

The edge shape detection may comprise rotation invariance processing toallow for edge shape detection of skew roadsign assets.

Edge shape detection may comprise comparison to reference shapes in ashape reference database.

The image recognition may comprise an image recognition stage comprisingcolour detection.

The colour detection may comprise colour juxtapose detection.

Colour detection may comprise comparison to reference colours in acolour reference database.

The image recognition may comprise an image recognition stage comprisingsymbol detection.

Symbol detection may comprise comparison to reference symbols in asymbol reference database.

Symbol detection may comprise alphanumeric symbol detection.

Symbol detection may comprise text recognition.

The mobile unit may further comprise an asset proximity detector fordetecting the proximity of roadside assets and the asset data capturedevice may be triggered by the asset proximity detector.

The mobile unit may comprise a grass cutter unit and the proximitydetector may be configured for detecting when the roadside asset may beengaged by the grass cutter unit.

The mobile unit may comprise a grass cutter unit and the grass cutterunit may be controllable to be moveable with respect to the mobile unitand the at least one digital camera may be configured to follow themovement of the grass cutter unit.

The method may further comprise image comparison for detecting roadsideasset damage or degradation to identify assets requiring maintenance.

The image comparison may comprise colour comparison.

The image comparison may comprise shape comparison.

The image comparison may comprise colour detection.

The image comparison may comprise symbol comparison.

The method may further comprise generating a map representationrepresenting the roadside section and the locations of the identifiedroadside assets along the roadside section.

The mobile unit may comprise at least one camera for capturing imagedata from the perspective of the mobile unit and the map representationmay be configured for selectively displaying image data from the atleast one camera at a plurality of locations along the roadside section.

The mobile unit may comprise forward and rearward facing cameras forrespectively capturing forward and rearward facing image data from theperspective of the mobile unit and the map representation may beconfigured for displaying before and after maintenance comparisonimagery utilising the image data received from the forward and rearwardfacing cameras.

The method may further comprise calculating a valuation for the roadsideassets, the valuation calculated in accordance with the asset typeidentified using the asset type image recognition technique.

The valuation may be further calculated in accordance with entry datesassociated with each of the asset types.

The method may further comprise using an asset condition estimate imagerecognition technique to estimate a condition of each of the roadsideassets and the valuation may be further calculated in accordance withthe estimated condition.

The method may further comprise calculating maintenance statisticsincluding at least one of last maintenance date, distance of theroadside section and average time to maintain the roadside section.

The method may further comprise the mobile unit receiving, via the datainterface, maintenance instruction data comprising instructions for themaintenance of the roadside section.

The mobile unit may be configured for sending the asset image data tothe server and the service performs the asset type image recognition.

In accordance with other aspects, there is provided a server forroadside asset tracking, the server may comprise a processor forprocessing digital data; a memory device for storing digital dataincluding computer program code, the memory device being operablycoupled to the processor; a network interface adapted for sending andreceiving data across a data network, the network interface beingoperably coupled to the processor; and a database adapted for storingasset data representing a plurality of assets, the asset data maycomprise at least unique asset identifier data and asset location data,the database being operably coupled to the processor, wherein, in use,the processor may be controlled by the computer program code to receive,via the network interface, from a remote data capture device, asset datarelating to an asset, the asset data may comprise at least location datarepresenting the location of the asset; and insert, into the database,the asset data in association with a unique asset identifier and thelocation data.

The asset data further may comprise the asset type and wherein theprocessor may be further controlled by the computer program code tostore, in the database, the asset type in association with the uniqueasset identifier.

The asset data further may comprise additional asset information andwherein the processor may be further controlled by the computer programcode to store, in the database, the additional asset information inassociation with the unique asset identifier.

The processor may be further controlled by the computer program code toselect an additional asset information category in accordance with theasset type.

The asset data further may comprise image data and wherein the processormay be further controlled by the computer program code to store, in thedatabase, the image data in association with the unique assetidentifier.

The processor may be further controlled by the computer program code tostore, in the database, valuation data representing a valuation of theasset in association with the unique asset identifier.

The processor may be further controlled by the computer program code tocalculate the valuation.

The processor may be further controlled by the computer program code tocalculate the valuation in accordance with an asset type.

The processor may be further controlled by the computer program code tocalculate the valuation in accordance with an asset lifespan allocatedfor the asset type.

The processor may be further controlled by the computer program code tocalculate the valuation in accordance with a depreciation schedule forthe asset type.

The processor may be further controlled by the computer program code toselect, from the database, previously recorded asset data representing aplurality of previously recorded assets; compare the asset data againstthe previously recorded asset data; and identify at least one missingasset in accordance with the previously recorded asset data and theasset data.

The processor may be further controlled by the computer program code toselect, from the database, previously recorded asset data representingthe asset; compare the asset data against the previously recorded assetdata; and identify the asset as requiring maintenance in accordance withthe asset data and the previously recorded asset data.

The previously recorded asset data may comprise previously recordedimage data representing a previous image of the asset and the asset datamay comprise present image data representing a previous image of theasset and wherein, in identifying the asset as requiring maintenance,the processor may be further controlled by the computer program code tocompare the previously recorded image data and the present image data.

The processor may be further controlled by the computer program code togenerate map representation data, the map representation data maycomprise a representation of the asset represented at an appropriatelocation of the asset.

The database may be further adapted to store maintenance task datarepresenting various maintenance tasks allocated to various maintenancemachinery for various maintenance routes and wherein, in use, theprocessor may be further controlled by the computer program code toreceive, via a network interface, from the remote data capture device,maintenance data relating to a maintenance task being performed bymaintenance machinery may comprise the remote data capture device; andstore, in the database, the maintenance data in relation to maintenancemachinery identification data identifying the maintenance machinery andread identification data representing the maintenance route.

The maintenance data may comprise the location of a maintenancemachinery.

The maintenance data may comprise maintenance image data.

The maintenance image data may comprise maintenance image datarepresenting a rearward image from the maintenance vehicle.

The maintenance image data may comprise maintenance image datarepresenting a forward image from the maintenance vehicle.

In use, the processor may be further controlled by the computer programcode to calculate at least one maintenance statistic in accordance withat least one of the maintenance data and the asset data.

The at least one maintenance statistic may comprise at least one ofroute number uniquely representing, total number of assets for theroute, total value of assets for the route, the last maintenance date ofthe route, the distance of the route, the average time to maintain theroute and the maintenance cost per kilometre for the route.

In use, the processor may be further controlled by the computer programcode to send, via the network interface, to the remote data capturedevice, maintenance instruction data.

According to yet another aspect, there is provided a data capture devicefor roadside asset tracking, the data capture device may comprise aprocessor for processing digital data; a memory device for storingdigital data including computer program code, the memory device beingoperably coupled to the processor; a location sensor adapted to sense alocation of the data capture device, the location sensor being operablycoupled to the processor; an asset data receiver adapted to receiveasset data; and a wireless network interface adapted for sending andreceiving data across a wireless data network, the network interfacebeing operably coupled to the processor, wherein, in use, the processormay be controlled by the computer program code to receive, from theasset data receiver, asset data relating to an asset; receive, from thelocation sensor location data representing the location of the datacapture device; and send, via the network interface, to an assettracking server, the asset data, the asset data may comprise thelocation data.

The asset data receiver may comprise an image capture device andwherein, in use, the asset data may comprise image data representing animage of the asset.

The image capture device may be a forward facing image capture device.

The image capture device may be a rearward facing image capture device.

The image capture device may comprise both a forward facing imagecapture device and a rearward image capture device and wherein, in use,the processor may be controlled by the computer program code to captureforward view image data representing a forward view of the asset; andsubsequently capture rearward view image data representing a rearwardview of the asset.

The processor may be further controlled by the computer program code toidentify the asset in accordance with the image data.

The processor may be further controlled by the computer program code toidentify the asset in accordance with an image recognition technique.

The image recognition technique may comprise an image comparisontechnique with a plurality of asset type images.

The processor may be further controlled by the computer program code tocapture the image data upon receipt of a trigger signal.

The asset data input may comprise an asset detector adapted to generatethe trigger signal.

The asset detector may be a physical asset detector.

The asset detector may be a noncontact asset detector.

The noncontact asset detector may comprise light beam interruptdetector.

The noncontact asset detector may comprise an ultrasonic proximitydetector.

The asset data input device may comprise a scanning device adapted toscan the asset data from a data bearing computer readable medium.

The data bearing computer readable medium may comprise a barcode.

The barcode may comprise at least one of a 2-D and 3-D barcode.

The data bearing computer readable medium may comprise a near fieldradio frequency tag.

The asset data input device may comprise a human interface deviceadapted to receive at least a subset of the asset data.

It should be noted that while the embodiments described herein aredescribed with reference to tracking roadside assets and maintainingroadsides, the embodiments described herein need not necessarily belimited to these particular applications and the embodiments may beapplicable to other applications also, including non-roadside locatedassets and maintenance, such as for, for example, the tracking andmaintenance of trees within an orchard and the like.

Other aspects of the invention are also disclosed.

BRIEF DESCRIPTION OF THE DRAWINGS

Notwithstanding any other forms which may fall within the scope of thepresent invention, a preferred embodiments of the disclosure will now bedescribed, by way of example only, with reference to the accompanyingdrawings in which:

FIG. 1 shows a system for roadside asset tracking in accordance with anembodiment of the present disclosure;

FIG. 2 shows a computing device for application in the system of FIG. 1in accordance with an embodiment of the present disclosure;

FIG. 3 shows maintenance machinery comprising a data capture device inaccordance with an embodiment of the present disclosure;

FIG. 4 shows a grass cutting device of the maintenance machinery of FIG.3 in accordance with an embodiment of the present disclosure; and

FIGS. 5 and 6 show exemplary graphical user interfaces displayed by thedata capture device of the system of FIG. 1 in accordance with anembodiment of the present disclosure; and

FIG. 7 shows an exemplary graphical user interface displayed by theadministrative client computing device of the system of FIG. 1 inaccordance with an embodiment of the present disclosure.

DESCRIPTION OF EMBODIMENTS

For the purposes of promoting an understanding of the principles inaccordance with the disclosure, reference will now be made to theembodiments illustrated in the drawings and specific language will beused to describe the same. It will nevertheless be understood that nolimitation of the scope of the disclosure is thereby intended. Anyalterations and further modifications of the inventive featuresillustrated herein, and any additional applications of the principles ofthe disclosure as illustrated herein, which would normally occur to oneskilled in the relevant art and having possession of this disclosure,are to be considered within the scope of the disclosure.

Before the structures, systems and associated methods relating to thesystem, server and data capture device for roadside asset tracking andmaintenance monitoring are disclosed and described, it is to beunderstood that this disclosure is not limited to the particularconfigurations, process steps, and the like disclosed herein as such mayvary somewhat. It is also to be understood that the terminology employedherein is used for the purpose of describing particular embodiments onlyand is not intended to be limiting since the scope of the disclosurewill be limited only by the claims and equivalents thereof.

In describing and claiming the subject matter of the disclosure, thefollowing terminology will be used in accordance with the definitionsset out below.

It must be noted that, as used in this specification and the appendedclaims, the singular forms “a,” “an,” and “the” include plural referentsunless the context clearly dictates otherwise.

As used herein, the terms “comprising,” “including,” “containing,”“characterised by,” and grammatical equivalents thereof are inclusive oropen-ended terms that do not exclude additional, unrecited elements ormethod steps.

It should be noted in the following description that like or the samereference numerals in different embodiments denote the same or similarfeatures.

A System for Asset Tracking

Turning now to FIG. 1, there is shown a system 100 for roadside assettracking.

The system 100 comprises at least one data capture device 105 operablycoupled to a server computing device 140 across a data network 130. Inthis manner, the data capture device 105 is adapted to recordinformation relating to various roadside assets and convey the assetdata to the server 140 for recordal. Operably coupled to the server 140is a database 135 adapted for storing asset and maintenance data.

The asset data may comprises asset type and location data representing aplurality of assets and their respective locations. Over and above this,the database 135 may store additional asset data as will be described infurther detail below, such as asset image data, asset valuation data andthe like.

The maintenance data may comprise maintenance data relating toparticular maintenance routes, the maintenance route distances,maintenance machinery and operators allocated to maintenance jobs andimage data being a record of maintenance performed for maintenancequality control purposes as will be described in further detail below.

The data capture device 105 comprises a wireless network interface 125for sending and receiving data across the network 130. The wirelessnetwork interface 125 is ideally suited for use by roadside maintenancemachinery, such as grass cutting devices as will be described in furtherdetail below, and should therefore be able to send and receive dataacross several kilometres. In this manner, in one embodiment, thenetwork interface 125 is a GSM interface adapted to send and receivedata across a GSM data network, such as a 3G, 4G data network or thelike.

It should be noted that in certain embodiments, as opposed to the datacapture device comprising a wireless network interface 125 for sendingthe asset data to the server 140, in other embodiments, the data capturedevice 105 comprises a local database adapted for storing the assetdata. In this manner, upon completion of an asset tracking run ormaintenance job, the data from the local database may be retrieved suchas by way of USB memory stick or the like for uploading to the server140 or other computing device.

Operably coupled to the wireless network interface 125 is a computingdevice 200 as will be described in further detail below, especially withreference to FIG. 2.

The computing device 200 is adapted to receive asset data and send theasset data to the server 140 across the network 130.

As such, operably coupled to the computing device 200 is an asset datainput device 115 adapted to receive asset data relating to a pluralityof assets. As can be appreciated, there are a number of manners in whichasset data relating to a plurality of assets may be input into the datacapture device. These different manners will be described in furtherdetail below, but for brief introductory purposes, in embodiments, theasset data input device 115 may comprise an imaging device, such as acamera or the like adapted to capture images of various assets. Theseimages of the assets may be then manually classified by operators, oralternatively utilised for automated image recognition purposes foridentifying assets.

Furthermore, the asset data input device 150 may comprise a scanningdevice adapted to scan a computer readable media attached to the asset,such as a barcode, near field communication tag and the like.

Yet further, the asset data input device 150 may comprise an assetproximity detector adapted for use in the below mentioned embodimentwhere the data capture device 105 is used in conjunction with a grasscutting device comprising an asset engagement. In this manner, the assetengagement may comprise an asset detector, such as a deflecting lever,light beam interrupt or the like adapted to sense the presence of theasset engaged by the asset engagement.

Yet further, the asset data input 150 may comprise a human input device,such as a keyboard and the like allowing a human operator to manuallyinput asset data relating to an asset.

The data capture device 155 may further comprise a display device (notshown) adapted for displaying digital data, especially the exemplarygraphical user interfaces provided below with reference to FIGS. 5 and6.

Furthermore, the system 100 may comprise a client computing device 200operably coupled to the server 140 and/or the data capture device 105 toperform various administrative functionality, including by way ofexemplary graphical user interface provided below with reference to FIG.7.

A Computing Device 200

Turning now to FIG. 2, there is shown a computing device 200 adapted forbeing implemented as any of the computing devices as substantiallyprovided in FIG. 1. Specifically, the computing device 200 may beadapted to perform the functionality performed by the server 140, datacapture device 105 or administrative client computing device 200.

In particular the computer implemented functionality for asset trackingand maintenance monitoring, as described herein, may be implemented ascomputer program code instructions executable by the computing device200. The computer program code instructions may be divided into one ormore computer program code instruction libraries, such as dynamic linklibraries (DLL), wherein each of the libraries performs a one or moresteps of the method. Additionally, a subset of the one or more of thelibraries may perform graphical user interface tasks relating to thesteps of the method.

The device 200 comprises semiconductor memory 210 comprising volatilememory such as random access memory (RAM) or read only memory (ROM). Thememory 210 may comprise either RAM or ROM or a combination of RAM andROM.

The device 200 comprises a computer program code storage medium reader260 for reading the computer program code instructions from computerprogram code storage media to 65. The storage media to 65 may be opticalmedia such as CD-ROM disks, magnetic media such as floppy disks and tapecassettes or flash media such as USB memory sticks.

The device further comprises I/O interface 235 for communicating withone or more peripheral devices. The I/O interface 235 may offer bothserial and parallel interface connectivity. For example, the I/Ointerface 235 may comprise a Small Computer System Interface (SCSI),Universal Serial Bus (USB) or similar I/O interface for interfacing withthe storage medium reader 260. The I/O interface 235 may alsocommunicate with one or more human input devices (HID) 255 such askeyboards, pointing devices, joysticks and the like. The I/O interface235 may also comprise a computer to computer interface, such as aRecommended Standard 232 (RS-232) interface, for interfacing the device200 with one or more personal computer (PC) devices 250. The I/Ointerface 235 may also comprise an audio interface for communicate audiosignals to one or more audio devices 245, such as a speaker or a buzzer.

The device 200 also comprises a network interface 240 for communicatingwith one or more computer networks 270. The network 270 may be a wirednetwork, such as a wired Ethernet' network or a wireless network, suchas a Bluetooth™ network, IEEE 802.11, cellular data network network orthe like. The network 280 may be a local area network (LAN), such as ahome or office computer network, or a wide area network (WAN), such asthe Internet or private WAN.

The device 200 comprises an arithmetic logic unit or processor 220 forperforming the computer program code instructions. The processor 220 maybe a reduced instruction set computer (RISC) or complex instruction setcomputer (CISC) processor or the like. The device 200 further comprisesa storage device 230, such as a magnetic disk hard drive or a solidstate disk drive.

Computer program code instructions may be loaded into the storage device230 from the storage media 265 using the storage medium reader 260 orfrom the network 270 using network interface 240. During the bootstrapphase, an operating system and one or more software applications areloaded from the storage device 230 into the memory 210. During thefetch-decode-execute cycle, the processor 220 fetches computer programcode instructions from memory 210, decodes the instructions into machinecode, executes the instructions and stores one or more intermediateresults in memory 210.

In this manner, the instructions stored in the memory 210, whenretrieved and executed by the processor 220, may configure the computingdevice 200 as a special-purpose machine that may perform the functionsdescribed herein.

The device 200 also comprises a video interface 215 for conveying videosignals to a display device 205, such as a liquid crystal display (LCD),cathode-ray tube (CRT) or similar display device.

The device 200 also comprises a communication bus subsystem 225 forinterconnecting the various devices described above. The bus subsystem225 may offer parallel connectivity such as Industry StandardArchitecture (ISA), conventional Peripheral Component Interconnect (PCI)and the like or serial connectivity such as PCI Express (PCIe), SerialAdvanced Technology Attachment (Serial ATA) and the like.

Maintenance Machinery

As alluded to above, in a preferred embodiment, the data capture device105 is adapted for utilisation of conjunction with maintenancemachinery.

Specifically, referring to FIG. 3, there is shown one version ofmaintenance machinery 300 comprising a maintenance vehicle 305 and agrass slasher 310.

The maintenance machinery 300 may comprise maintenance machinery as isdisclosed in respect of patent application PCT/AU2014/050437 in the nameof the present Applicant, the entire contents of which are incorporatedherein by reference.

The maintenance vehicle 305, being a bobcat, tractor or other similarvehicle is adapted to move the grass slasher 310 along roadsides forgrass cutting purposes. While performing the maintenance, by providingthe maintenance machinery 300 with the data capture device 105, theroadside assets may be advantageously simultaneously recorded andmaintained and the maintenance performed by the maintenance machinery300 may be recorded for subsequent quality control verificationpurposes.

Further specifically, referring to FIG. 4, there is shown a perspectiveview of the grass slasher 310 in further detail. In this particularembodiment, the grass slasher 310 comprises an asset engagement 310 ordock adapted to engage a roadside asset, such as a traffic controlsignage post or the like so as to be able to cut about the signage post.

In this manner, the asset engagement 310 may comprise theabove-mentioned asset detector adapted to detect the proximity of thepost so as to be able to record asset data.

Exemplary Embodiments

Having described the above system architecture, there will now bedescribed various exemplary embodiments for illustrative purposes,including describing the functions performed by the server 140 and datacapture device 105. It should be noted that these embodiments areexemplary only and that no limitation should necessarily be imputed tothe embodiments described herein other than those specificallyenumerated in the claims.

In these exemplary embodiments, there will be described the utilisationof the maintenance machinery 300 as substantially provided in FIGS. 3and 4 for tracking roadside assets during the grass cutting process.However, again, this application is exemplary only and the system 100may be equally applicable for provision in other applications, includingapplications not necessarily comprising maintenance machinery and notnecessarily for assets located along roadsides.

Server Functionality

Now with this exemplary application in mind, there will now be describedthe functionality performed by the server 140. Specifically, in thisembodiment, the server 140 comprises a processor 220 for processingdigital data, a memory device 210 for storing digital data includingcomputer program code, the memory device 210 been operably coupled tothe processor 220. Furthermore, the server 120 comprises a networkinterface adapted for sending and receiving data across the data network130, the network interface been operably coupled to the processor 220.Furthermore, the server 140 comprises a database interface forinterfacing with the database 135. In this regard, the database isadapted for storing asset data representing a plurality of assetswherein the asset data comprises at least a unique asset identifier dataand asset location data. The database interface is similarly operablycoupled to the processor 220.

Server Functionality—Data Recorded

Now, in use, the server 140 is adapted to receive, from the data capturedevice 105 asset data relating to a roadside asset, the asset datacomprising at least the location of the roadside asset. In this manner,the server 140 is adapted to store, in the database 135, asset type andlocation data representing the asset and the location thereof.

For example, during the grass cutting process, should the maintenancevehicle 300 come across and 80 km an hour speed signage post, the datacapture device 105 would send asset data relating to the speed signagepost and the location thereof, as ascertained from the location sensor110, to the server 140.

In this manner, the server 140 may record the location of the speedsignage post. If the speed signage post has not yet been recorded in thedatabase 135, the server 140 may create an entry for the speed signagepost.

Now, further information may be provided by the data capture device 105to the server 140.

In one embodiment, the server 140 may further be adapted to receive,from the data capture device 105, the asset type. For example, for theabove-mentioned speed signage post, the speed signage post asset typemay be allocated. Other asset types may include, for example,informational street signage, warning street signage, and other assettypes not specifically related to signage, such as roadside barriers,speed bumps, cattle grids, water fountains, side roads and the like.

A further embodiment, the server 140 may be adapted to store additionalinformation in relation to the asset type. For example, for the speedsignage asset type, the speed may be recorded, such as 80 km per hour.In this manner, should the particular street sign require replacement,the appropriate speed signage of the replacement speed sign may beascertained from the database 135.

Other additional information may include the condition of the roadsideasset, such as a rating of 1 to 10.

In this embodiment, the system 100 may be configured for differingadditional information according to differing asset types. In thismanner, the system 100 may record or prompt for input the appropriateadditional information as required for the particular asset type.

In one preferred embodiment, the server 140 is adapted to receive, fromthe data capture device 105 image data relating to a particular assetfor storage within the database 135.

Specifically, the asset data input 115, as will be described in furtherdetail below, in one embodiment may comprise an imaging device such as acamera or the like. In this manner, upon recordal of an asset by thedata capture device 105, an image of the asset may be captured using thecamera. In this manner, image data may be stored for each asset recordedwithin the database 135, for subsequent visual inspection and otherpurposes.

In embodiments, as will be described in further detail below, the system100 may be adapted for the automated identification of assets usingimage recognition technique performed on the image data.

In yet further embodiments, the system 100 may be adapted to allocate amonetary valuation for each asset. In this manner, during the assetrecording process, a monetary valuation of the asset inventory may beascertained from the server 140 which may serve various purposes,including for funding for maintenance and the like.

In this embodiment, the server 140 may be adapted to apply adepreciation schedule against assets so as to account for depreciationover time. Furthermore, the server 140 may be further configured with aservice life for each type of asset for asset replacement purposes.

In this embodiment, the server 140 may be adapted to select theappropriate depreciation schedule and/or service life in accordance withthe appropriate asset type. For example, speed control signage maydepreciate faster and have a shorter service life as opposed to aroadside barrier, for example.

Server Functionality—Identifying Missing Assets

In one particular preferred embodiment, the server 140 is adapted toidentify missing assets, such as, for example, in the event of aparticular roadside speed control signage having been removed ordislocated from vehicle impact.

For such missing asset identification, the functionality performed bythe server 140 usually comprises a first pass wherein particular assetsare recorded for the first time. For example, for a particular sectionof road, the maintenance vehicle 300 may be sent to capture theabove-mentioned assets data relating to the roadside assets for theroadside section for the first time.

As such, upon subsequent passes, the server 140 is adapted to identifywhether any of the previously recorded assets failed to be recorded.

For example, for a second pass, the data capture device 105 may report,to the server 140, a previously recorded 80 km/h speed control sign butfail to report a previously recorded 110 km/h speed control sign. Inthis manner, the server 140 would be adapted to identify the omitted 110km/h speed control sign and take appropriate action. Such appropriateaction may include notifying the operator of the maintenance machinery300 accordingly such that the operator may acknowledge that the speedcontrol sign is indeed missing or alternatively rectify an omission.

Furthermore, the server 140 may compile a database of missing roadsideassets such that maintenance crews may be scheduled and deployedaccordingly.

In embodiments as will be described in further detail below, theexemplary graphical user interfaces as may be displayed by the datacapture device 105 as will be described with reference to FIGS. 5 and 6may display upcoming assets on a map representation of the likerepresenting previously recorded roadside assets. In this manner, theroadside operator would know in advance of approaching roadside assets,or where previously recorded roadside assets should be.

In embodiments, as opposed to the system 100 identifying missing assets,the operator, or the data capture device 105 in an automated manner, mayidentify assets requiring replacement. For the operator initiatedflagging of assets requiring maintenance, should the operator notice aparticular asset is damaged, such as having been blackened from bushfireor the like, the operator may flag the particular asset, such as byusing the human interface device of the asset data input 115 to flagthat the particular assets requires maintenance. In other embodiments,the data capture device 105, especially by utilising image recognitiontechnique may identify assets requiring maintenance, such as whereinimage data recorded from an asset deviates from a standard asset image,such as wherein a street sign is blackened, bent, obliquely orientatedor the like.

Server Functionality—Generating Map Data

In an embodiment, the server 140 is adapted to generate map data formanagement purposes. In particular, the map data may be displayed by thedisplay device of the client computing device 200, especially withreference to the exemplary graphical user interface as will be describedin further detail below with reference to FIG. 7.

In this manner, administrators, such as councils and the like may viewmap representations having superimpose thereon the location of variousassets, such as by way of appropriate icon or the like. In embodiments,the icon type may represent the asset type and furthermore, each iconmay be user selectable to display further information in relation to theasset, such as by displaying the image data for the asset, theadditional information recorded for the asset and the like.

Server Functionality—Maintenance Tracking

In embodiments, the server 140 is further adapted for maintenancetracking, additionally, or alternative to asset tracking.

For example, grass cutting maintenance may be tracked and managed by theserver 140.

For example, road verges may require cutting 5 times a year, includingat differing heights depending on whether the grass is seeding or not.

In this manner, various maintenance may be scheduled by the server 140.Thereafter, once the maintenance is in progress by the maintenancemachinery 300, the current status of the maintenance may be recorded bythe server 140, especially in ascertaining the percentage work completedin accordance with the location of the maintenance machinery 300 as itis received from the data capture device 105.

In this manner, the server 140 may record, for display by the clientcomputing device 200, various statistics relating to various maintenancebeing performed, or requiring performance. Such statistics may includework to do, work in progress and work performed.

Similarly, by using map representations, the client computing device 200may be adapted to display map representations showing the locations ofvarious maintenance machinery 300, their respective work routes, workcompleted and the like.

In embodiments, and referring to FIG. 3, the maintenance machinery 300may comprise a forward facing camera 320 and a rearward facing camera315. In this manner, at periodic intervals, the server 140 may beadapted to receive, from the data capture device 105 image data fromthese cameras such that an administrator, utilising the client computingdevice 200 may be adapted to view the forward view and the rearward viewof the maintenance machinery 300 so as to be able to ascertain thequality of the work performed, for example. It should be noted that inembodiment, the maintenance machinery 300 may comprise either theforward facing camera 320 or the rearward facing camera 315 in lieu ofhaving both.

In these embodiments, the server 140 may be adapted to send maintenanceinstructions to the data capture device 200. Such maintenanceinstructions may include, for example, the appropriate height at whichto cut the grass. In this example, the operator, viewing the displaydevice of the data capture device 105 may view the required grass heightand set the grass cutter 310 height accordingly.

Data Capture Device Functionality

Having described the exemplary functionality is performed by the server140, there will now be described exemplary functionality performed bythe data capture device 105 in accordance with the exemplary embodimentof using maintenance machinery 300 for grass cutting purposes inconjunction with the data capture device 105 for recording asset datarelating to various roadside assets and monitoring the maintenanceperformed during the grass cutting process.

As alluded to above, the data capture device 105 similarly comprises aprocessor 220 for processing digital data, a memory device 210 forstoring digital data including computer program code, the memory device210 being operably coupled to the processor 220.

Furthermore, the data capture device 105 comprises a location sensor 110for sensing a location of the data capture device, the location sensorbeing operably coupled to the processor 220. In embodiments, thelocation sensor 110 may comprise a GPS receiver.

Furthermore, the data capture device 105 comprises an asset datareceiver 105 adapted for receiving asset data relating to various assetsincluding in the manners described in further detail below.

Furthermore, the data capture device 105 comprises a wireless networkinterface adapted for sending and receiving data across a wireless datanetwork 130 to the server 140. As alluded to above, given the remoteoperational locations of the machinery 300, the wireless networkinterface 125 may comprise a GSM data interface adapted for sending dataacross a GSM network.

In a preferred embodiment, the data capture device 105 is a small formfactor ruggedised computing device, such as a tablet computing devicehave an inbuilt location sensing and display functionality, including,in embodiments, image capture functionality. In this embodiment, thedata capture device 105 computing device may be utilised in isolation,or alternatively coupled to various other electronic computing deviceslocated about the machinery 300, such as the forward and rearward facingcamera is 320, 315, tactile sensors and the like.

In a preferred embodiment, the data capture device 105 is adapted toautomate the asset data recording process requiring minimal interventionfrom the operator of the machinery 300.

Data Capture Device Functionality—Data Sent

As such, in use, as the machinery 300 cuts grass, as the machinery 300encounters various roadside assets, the data capture device 105 isadapted to receive from the asset data input, asset data relating to theasset and send, via the wireless network interface 125 and the network130, the asset data to the server 140 for recordal within the database135.

Additionally, and as alluded to above, in embodiments, the data capturedevice 105 may be adapted to receive information from the server 140also, including information relating to previously recorded assets,maintenance instructions and the like.

Data Capture Device Functionality—Imaging

Now, there will be described a first aspect of the asset data input 115wherein the asset data input 115 utilises imaging for the purposes ofrecording asset data.

In this embodiment, and as alluded to above, the machinery 300 maycomprise cameras, especially the forward facing camera 320 to recordinformation relating to an asset.

Specifically, the forward facing camera 320 would be appropriatelylocated for an ideal vantage for recording image data relating tovarious roadside assets. For example, the forward facing camera 320 maybe mounted at the forward upper edge of the canopy of the vehicle 305 oralternatively located on the cutting device 310 for example.

In embodiments, the rearward facing camera 315 may be adapted to capturea rearward image of the asset also such that the administrator may beable to view both sides of the asset or view the maintenance that hasbeen performed. In this manner, during operation, the data capturedevice 105 may be adapted to record a forward facing image of the asset,and subsequently, at the appropriate time, record a rearward image ofthe asset.

The timing for the taking of the second rearward facing image may betimed in accordance with a predetermined time interval, such as 10seconds, the speed of the maintenance vehicle 310 or wherein the datacapture device 105 captures the second rearward facing image inaccordance with the speed of the maintenance vehicle 305, or thelocation of the maintenance vehicle 310 wherein the data capture device105 captures the second rearward facing image in accordance with thelocation of the vehicle, such as wherein the maintenance vehicle 305 is5 m past the asset.

Now, in one embodiment, the system 100 is adapted for the automatedidentification of assets in accordance with the image data. In oneparticular embodiment, the system 100 may employ image recognition forrecognising various assets and asset types. It should be noted that theimage recognition may be performed by the data capture device 105, orwhere the data capture device is a low-power computing device, by themore powerful server 140.

In this manner, at intervals, the data capture device 105 may be adaptedto capture images from the cameras wherein the images are processedusing an image processing technique. For example, should the datacapture device 105 capturing image comprising an 80 km an hour streetsign, the system 100 may identify the images comprising the Street signtype and of the 80 km an hour additional information for the streetsign.

In embodiments, the database 135 may comprise exemplary representativeimagery of various roadside assets for comparison purposes during theimage recognition technique.

In other embodiments, the capturing of images may be triggered. Forexample, and especially referring to the embodiment provided in FIG. 4shown the cutting device 310 in further detail, as can be seen, in thisembodiment, the cutting device 310 comprises an asset engagement 410.The asset engagement 410 is adapted to receive the asset therein so asto cut the grass about the asset. During the engagement of the assets bythe asset engagement 410, the asset may be detected by the assetdetector 405 which may be a tactile asset detector, such as a deflectedlever, a light beam interrupted or the like.

As such, upon receiving indication of the detection of an asset by theasset detector, the data capture device 105 may be adapted to capture animage.

It should be noted that other asset detectors may be employed such as byway of ultrasonic proximity detection device adapted to detect assetswithin proximity of the machinery 300.

Data Capture Device Functionality—Scanning

In other embodiments, the asset data input device 115 may be adapted toread computer readable information from a computer readable data bearingmedia attached to an asset.

Such computer readable data bearing media may comprise a barcode, suchas a 2-D or 3-D barcode, or near field radio frequency communicationdevice and the like.

For example, all roadside assets may be provided with low-cost NFC tagsfor detection by approximate data capture devices 105 during the grasscutting run.

Data Capture Device Functionality—Asset Detector

In an embodiment, the acetate input 150 may comprise the above-mentionedasset detector adapted to detect an asset. As alluded to above, in onemanner, the asset detector may be located about the asset engagement 410to detect when an asset has been engaged within the asset detector.

However, in embodiments, the asset detector need not necessarily be usedin conjunction with an asset engagement and may, for example comprisephysical object proximity detectors located about the vehicle 310. Forexample, the asset detector may comprise ultrasonic proximity detectorsadapted to detect objects within proximity of the vehicle 310.

Data Capture Device Functionality—Human Interface Device

In one embodiment, alternatively or additionally, asset data may berecorded by way of a human input device. In one embodiment, the humaninput device comprises a touch sensitive overlay over the display deviceof the data capture device comprising inputs allowing the user to inputvarious information.

In embodiments, all of the asset data may be input using the human inputdevice such as wherein the operator of the machinery 300 manuallyrecords each asset.

In other embodiments, the asset data may be complimented using the humaninput device such as wherein, for example, the data capture device 105detects a speed control road sign wherein the human operator inputs thespeed limit of the detected speed control road sign.

Exemplary Graphical User Interfaces

As alluded to above, there will now be described exemplary graphicaluser interfaces as may be displayed by the display device of the datacapture device 105 and the client computing device 200.

Exemplary Graphical User Interfaces—Data Capture Device

FIGS. 5 and 6 show exemplary graphical user interfaces displayed by thedisplay device of the data capture device 105.

Specifically, referring to FIG. 5, there is shown an exemplary graphicaluser interface 500 wherein the data capture device 105 is in roadsidemaintenance mode.

Specifically, the left hand side of the interface 500 comprises a maprepresentation comprising a bottom portion located map overview and atop located current location overview showing the location of the datacapture device 105 overlaid a map representation. In the embodimentshown, the data capture device 105 is shown as the crosshair iconadjacent the roadside.

The map representation further comprises a plurality of iconsrepresenting the roadside assets. Any particular map representationshown, the data capture device 105 is represented as currently beingadjacent and asset, one asset been represented as being in front of thedata capture device 105 and two assets as been recorded as being behindthe data capture device.

The right hand side of the interface 500 comprises asset specificinformation.

Specifically, the upper located portion comprises information relatingto the current asset, as can be seen, the current asset has beenallocated unique asset identify A4262 and there is shown image datarelating to the asset. In this manner, the operator of the machinery 300may visually compare the asset with the image data as recorded by thesystem 100 for comparison purposes. Adjacent the image data of the assetmay be the further additional information relating to the asset, such asthe type of asset, the condition, when the grass was last cut and thelike.

Furthermore, the lower located portion of the interface 500 may compriseinformation relating to the next asset, given as asset A4263 and anappropriate image.

In this manner, by showing the proximate pre-recorded assets, theoperator may easily identify if an asset is missing or has been damagedsince the last recordal.

Furthermore, for the above-mentioned maintenance tracking purposes, thelower located portion of the interface 500 may further comprise arearward view image of the rear of the maintenance vehicle as iscaptured by rearward facing camera 315 to record the grass as havingbeen cut by the maintenance vehicle 300.

Turning now to FIG. 6, there is shown an exemplary graphical userinterface 600 wherein the data capture device 105 is in setup mode.Specifically, during the setup mode, various assets may be recorded,such as during the above-mentioned first pass.

Specifically, the left hand side of the interface 600 is substantiallythe same as for interface 500. However, for the right hand side, theinterface 600 comprises a portion allowing for the capturing of assetdata.

As can be seen, the upper right-hand portion of the interface 600 allowsthe operator to record and asset for the first time. Specifically, thisportion comprises an image of the asset for recordal. As mentionedabove, the image of the asset may be taken manually by the operator, orin an automated manner such as wherein the data capture device 105utilises image recognition technique, proximity detection or the like.

Once the image of the asset has been taken by the operator, or the assetidentified by the data capture device 105, the interface 600 may allowthe operator to confirm the asset including in inputting additionalinformation relating to the asset.

Exemplary Graphical User Interfaces—Administrative Client ComputingDevice

Turning now to FIG. 7, there is shown an exemplary graphical userinterface 700 as displayed by the administrative client computing device200. Typically, and as alluded to above, the client computing device 200would be operated by various administrators, such as council workers andthe like.

As can be seen, the lower left hand portion of the interface 700comprises a map representation showing the location of the data capturedevice 105 and various recorded assets. In a preferred embodiment, thelocation of the data capture device 105 may be shown in real time.

Furthermore, a particular asset may be selected for the purposes ofdisplaying further information. In the interface 700, asset a 4262 hasbeen selected wherein, as can be seen, the top right-hand portion of theinterface 700 comprises further information in relation to the assetincluding comprising an image of the asset, and additional informationrelating to the asset.

As can be seen, the additional information relating to the assetcomprises additional information that the asset is in excellentcondition, that it is a reflector post A3 was last maintained on 13 Oct.2013, the coordinates of the asset, the asset value of $300 and theasset having an estimated life span of two years.

Furthermore, for the above mentioned maintenance tracking, the top lefthand side of the interface 700 may comprise a rear image of themaintenance vehicle 300. In this manner, should the administratorvisually identify from the image that the grass as not been cutcorrectly, the administrator may take appropriate action, such as bycontacting the operator to take appropriate remedial action.

It should be noted that the substantial real time imagery from themaintenance vehicle 300 may be displayed within the interface 700. Inother embodiments, a timelapse of the maintenance imagery may be shownwherein, for example, the operator drags the icon of the maintenancevehicle 300 to various locations along the map representation so as tobe able to view the maintenance imagery at differing locations of themap.

Furthermore, the bottom right hand side of the interface 700 comprisesvarious information relating to the particular maintenance task. As canbe seen, this particular grass cutting maintenance task has beenallocated to route number 12, that route number 12 has 543 assetstotalling a value of $76,000, that the route was last maintained on 13Oct. 2013, that route 1260 km in length, takes an average of 16 hoursand 32 minutes to maintain and cost $130 per kilometre to maintain.

This portion of the interface 700 further comprises a menu allowing theadministrator to view and manage various contract statistics, jobstatistics, council averages national averages and routes.

Exemplary Embodiment

There will now be described an exemplary embodiment method for roadsideasset tracking and maintenance monitoring. Specifically, in thisexemplary embodiment, the method comprises utilising a mobile unit, suchas the maintenance machinery 300 as substantially shown in FIG. 3 forgrass cutting, the mobile unit comprising a data capture device 100(such as a small form factor tablet computing device) having an assetdata capture device 115 (such as a camera for capturing roadside assertimage data); an inbuilt or external global positioning system (GPS)receiver 110 and a data interface 125 for communicating with an assetmanagement server 140, the asset management server 140 comprising anasset tracking register database 135.

The method comprises deploying a mobile unit 305 (such as theabove-described maintenance machinery or the like) alongside a roadsidesection, primarily while performing roadside maintenance, but notnecessarily so.

Now, the method comprises utilising an asset type image recognitiontechnique for automating the identification of the roadside assets. Forexample, the roadside asset types may be divided into any number ofroadside asset type categories such as posts, barriers, roadsigns andthe like. Other categories, such as subcategories may also be utilisedsuch as, for example, wherein roadsigns are divided into warning,informational and traffic management signs. For traffic managementsigns, such as speed management signs, further categories may beemployed relating to the speed limit, for example.

Now, during any roadside pass or run, the method comprises inserting,into the asset tracking register database 135, newly identified assetsand their respective locations. For example, should a new road post beinstalled on a road corner, the method may comprise identifying the newroad post installed at the particular location of the updating of thedatabase 135 to record the new post of a particular type and the newlocation.

Now, in a preferred embodiment, for subsequent passes, the methodfurther comprises identifying missing roadside assets by comparing thepreviously identified asset types at the respective locations. Forexample, should a roadside signpost which had been previously identifiedbe subsequently removed, during a subsequent pass of the mobile unit305, the method may identify that the roadside asset is missing suchthat appropriate remedial action may be taken. For example, inembodiments, the system 100 may be configured such that, should themobile unit 305 pass 10 m beyond from where a roadside asset waspreviously recorded, the system 100 may identify the asset as beingmissing.

When identifying a missing asset, the database 135 may be updated toflag the relevant missing roadside asset.

In embodiments, the operator of the mobile unit 305 may be prompted toconfirm the missing asset including in the system 100 displaying animage of the asset as was previously recorded. The operator may thenconfirm that the roadside asset is indeed missing.

In this manner, the system 100 may generate a register of remedialaction tasks specify in roadside assets that require replacing.

Now, as alluded to above, the asset data capture device 115 comprises acamera (or is operably couples to a camera) for capturing roadside assetimage data. In this manner, the method comprises utilising imagerecognition for identifying the roadside asset types.

For example, along the roadside section the camera may capture periodicimages, such as in front of the mobile unit 300, or that which isengaged by the grass cutting device 310 and wherein the method comprisesemploying the asset type image recognition to identify assets from thoseimages. For example, the method may comprise identifying roadside posts,roadside signage and the like from the image is captured by the camera.

In a preferred embodiment, especially given the computationallyintensive nature of image identification, the data capture device 105may transmit the image data and the location data from the locationsensor 110 to the server 140 for processing by the server 140.

Now, so as to suit the image recognition for roadside assetidentification, the image recognition may comprise a number of imagerecognition stages described below.

As such, in embodiments, the image recognition may comprise an imagerecognition stage comprising edge shape detection to detect shapes ofroadside assets. Edge detection may be performed in accordance withintensity (such as from greyscale images) or colour variations betweenthe roadside asset and the background.

For example, roadside posts may have a distinctive rectangular shapehaving particular dimension ranges allowing the method to identify suchroadside posts accordingly.

Now, particular for roadside signage, differing types of roadside signsmay comprise differing shapes which may be utilised when identifying theroadside assets. For example, warning signs may have a triangular shapewhereas traffic management signs may have a circular shape. In thismanner, by identifying a particular shape, the method may identify thesign type when identifying a roadside asset.

In embodiments, the method may comprise utilising shape rotationinvariance filtering to account for roadside signs which are not exactlyupright, such as those that have been installed or knocked skew. In thismanner, should a triangular sign be skew, the image identification mayyet recognise the triangular shape.

Image recognition may further comprise colour detection so as to furtherenhance the image identification. For example, the above-describedroadside posts may have a distinctive white colouring which may assistthe identification thereof. Furthermore, and especially for roadsidesigns, the above-described different types of roadside signs may havediffering colour types also.

In embodiments, and especially for roadside signs, the colour detectionmay comprise colour juxtaposed detection so as to, for example, identifya red border against a white background of a restrictional roadsidesign.

In a further embodiment, the image recognition may comprise symboldetection. For example, roadside signage may comprise differing symbols,such as, a koala bear symbol shape warning of wildlife ahead. Thesymbols may further represent alphanumeric symbols such as numberingutilised on speed management signs. In further embodiment, the imagerecognition may utilise text recognition so as to identify, textutilised within roadside signage.

In embodiments, the image recognition may utilise a combination of theabove described image recognition techniques. For example, in oneembodiment, the image recognition may utilise a combination of bothshape detection and symbol detection. For further accuracy, colourdetection may additionally be employed.

In embodiments, the image recognition may utilise reference databasesfor the purposes of enhancing accuracy. For example, in one embodiment,the method may comprise utilising correlation to correlate the capturedroadside asset image data with known roadside assets stored within aroadside assets image database. It should be noted that such imagecorrelation may be performed in accordance with the entire image.However, in embodiments, correlation may be performed utilising theseparate shape, colour, symbol and text reference databases.

For example, in identify a triangular shape and a koala bear symbol, thesystem 100 may identify the particular type of roadside signageaccordingly.

Now, in one embodiment, the mobile unit asset data capture device 115comprises a detector in the form of an asset proximity detector todetect the proximity of the roadside asset. The detector may trigger theasset data capture device 115 to capture an image of the roadside asset.

For example, in the embodiment where the mobile unit comprises a grasscutter 310 as is substantially provided in FIGS. 3 and 4, the detectormay take the form of a physical contact, laser trip or the like 405within the grass cutter asset engagement 410. In this manner, when thegrass cutter 310 engages an asset within the asset engagement 410 to cutaround the asset, the correspondingly located camera, having a view ofthe grass cutter 310 captures an image of the asset.

It should be noted that in embodiments, the grass cutter 305 maycomprise a plurality of grass cutter devices such as the frontwardlocated grass cutter device 310 as substantially shown in FIG. 4 and aside arm gantry-type movable grass cutter device (not shown). Forexample, the side arm movable grass cutter device may be utilised forperforming delicate grass cutting, such as around posts of a roadsidebarrier or the like. In this manner, the mobile unit 305 may comprise aside facing camera so as to be able to capture image data of assetsengaged by the side arm cutting device also.

In embodiments, where the side arm is movable the side facing camera maybe gimbal mounted or the like so as to follow the location of the end ofthe side arm.

In embodiment, the side movable grass cutting device may be marked witha laser so as to allow the side camera to follow the grass cuttingdevice.

The method may further comprise image comparison for detecting roadsideasset damage or degradation to identify roadside assets requiringmaintenance. For example, the method may compare asset image dataagainst previously recorded asset image data and detect changes incolour, shape, the symbols or text represented on roadside asset (so asto identify missing letters and the like

For those assets that show a change in colour or shape exceeding athreshold may trigger the system to update the database 135 with a flagindicating that a particular asset requires maintenance. For example,should a roadside be damaged in a bushfire and therefore be blackened,the image comparison may detect the colour degradation and flag theasset for maintenance.

Furthermore, should a roadside post be hit by a passing vehicle all ofthe like and therefore be skew or otherwise bent out of shape, thesystem may identify the change of shape or orientation and flag theasset for maintenance.

Furthermore, should a letter be missing from a roadside signpost, thesystem may identify the missing letter or the change to the text andflag the roadside signpost for maintenance.

The method may further comprise generating a map representation showingthe roadside sections and the locations of the roadside assets along theroadside section. Specifically, FIGS. 5 and 6 show the map presentationwhich may be displayed by the data capture device 100 on the mobile uniton FIG. 7 may display the representation displayed at a headquarters.

As can be seen, the representations comprise a map representationrepresenting the roadside section and the locations of the identifiedroadside assets along the roadside section. The map representation atheadquarters may display the current location of the mobile unit.

Clicking on each of the icons of each respective roadside asset maydisplay further information in relation to each roadside asset,including an image of the roadside asset, such as a front and rear imageof the roadside asset with such as available.

The map representation is displayed by the mobile unit may display imagedata relating to the closest asset, such as the next roadside assetincluding an image of the next roadside asset. In this manner, theoperator may view the previously recorded image of the asset and reportany changes to the asset that the operator notices. For any newlyidentified asset, the mobile unit operator interface allows the operatorto confirm that new asset and input other information such as anyfurther characteristics or notes.

In embodiments, the operator interface may allow the operator to reportincidents, such as wildlife casualties or roadside hazards, such asflooding, fire and the like.

Now, in embodiments, and referring to FIG. 3, as can be seen, the mobileunit 305 may comprise a forward camera 320 and a rearward camera 315 forrespectively capturing forward and rearward image data from theperspective of the mobile unit.

As such, at headquarters, perspective views may be displayed by theinterface 700 either in real time from the current location of themobile unit, or at any particular locations, such as a road bend or thelike.

In embodiments, the image data recorded from the cameras 315 and 320 maybe utilised at headquarters for quality control purposes by comparingbefore and after maintenance imagery. For example, should the mobileunit have cut the grass to the incorrect height, such may be noticedfrom the imagery and rectified maintenance instructions sent to themobile unit.

Now, especially referring to the interface 700 as substantially shown inFIG. 7, the method may further comprise calculating a valuation of theroadside assets along the roadside section. In this regard, thevaluation may be calculated in accordance with the assets type which hasbeen identified using the above-described asset type image recognitiontechnique. For example, the database 135 may comprise a register ofasset type values which may be taken into account in determining thevalue of the roadside assets.

In embodiments, the method may take into account depreciation whereinthe date at which the asset was first installed are identified by themethod may be taken into account wherein, for example, road posts may bedepreciated over 2 years. In this regard, the method may furthercomprise identifying those roadside assets requiring replacement onaccount of their having reached the end of their service life.

Calculating the valuation of the assets may further take into accountthe condition of the asset. In embodiment, the method may utilise anasset condition estimate image recognition technique for estimating acondition of each of the roadside assets. For example, referring to theexemplary interface 700 as can be seen, asset A4262, the condition ofthe asset has been deemed to be excellent. The asset condition estimateimage recognition technique to take into account various factors indetermining the condition, such as colour, shape and the like.

As can be seen, the interface 700 further displays various maintenancestatistics including at least one of last maintenance date, distance ofthe roadside section and average time to maintain the roadside section.

It should be noted that in embodiments, as opposed to the data capturedevice 105 being located on a movable unit, such as the maintenancemachinery 105 and the like, the data capture device 105 may be aportable unit configured for pedestrian utilisation. In this manner, forexample, a user may walk along a trail, route or the like capturinginformation relating to various route or trail assets. In embodiment,the data capture device 105 may take the form of a tablet computingdevice have an inbuilt camera, GPS and data connectivity functionalityconfigured with appropriate software such that no substantial hardwaremodification need be required.

Interpretation

Wireless:

The invention may be embodied using devices conforming to other networkstandards and for other applications, including, for example other WLANstandards and other wireless standards. Applications that can beaccommodated include IEEE 802.11 wireless LANs and links, and wirelessEthernet.

In the context of this document, the term “wireless” and its derivativesmay be used to describe circuits, devices, systems, methods, techniques,communications channels, etc., that may communicate data through the useof modulated electromagnetic radiation through a non-solid medium. Theterm does not imply that the associated devices do not contain anywires, although in some embodiments they might not. In the context ofthis document, the term “wired” and its derivatives may be used todescribe circuits, devices, systems, methods, techniques, communicationschannels, etc., that may communicate data through the use of modulatedelectromagnetic radiation through a solid medium. The term does notimply that the associated devices are coupled by electrically conductivewires.

Processes:

Unless specifically stated otherwise, as apparent from the followingdiscussions, it is appreciated that throughout the specificationdiscussions utilizing terms such as “processing”, “computing”,“calculating”, “determining”, “analysing” or the like, refer to theaction and/or processes of a computer or computing system, or similarelectronic computing device, that manipulate and/or transform datarepresented as physical, such as electronic, quantities into other datasimilarly represented as physical quantities.

Processor:

In a similar manner, the term “processor” may refer to any device orportion of a device that processes electronic data, e.g., from registersand/or memory to transform that electronic data into other electronicdata that, e.g., may be stored in registers and/or memory. A “computer”or a “computing device” or a “computing machine” or a “computingplatform” may include one or more processors.

The methodologies described herein are, in one embodiment, performableby one or more processors that accept computer-readable (also calledmachine-readable) code containing a set of instructions that whenexecuted by one or more of the processors carry out at least one of themethods described herein. Any processor capable of executing a set ofinstructions (sequential or otherwise) that specify actions to be takenare included. Thus, one example is a typical processing system thatincludes one or more processors. The processing system further mayinclude a memory subsystem including main RAM and/or a static RAM,and/or ROM.

Computer-Readable Medium:

Furthermore, a computer-readable carrier medium may form, or be includedin a computer program product. A computer program product can be storedon a computer usable carrier medium, the computer program productcomprising a computer readable program means for causing a processor toperform a method as described herein.

Networked or Multiple Processors:

In alternative embodiments, the one or more processors operate as astandalone device or may be connected, e.g., networked to otherprocessor(s), in a networked deployment, the one or more processors mayoperate in the capacity of a server or a client machine in server-clientnetwork environment, or as a peer machine in a peer-to-peer ordistributed network environment. The one or more processors may form aweb appliance, a network router, switch or bridge, or any machinecapable of executing a set of instructions (sequential or otherwise)that specify actions to be taken by that machine.

Note that while some diagram(s) only show(s) a single processor and asingle memory that carries the computer-readable code, those in the artwill understand that many of the components described above areincluded, but not explicitly shown or described in order not to obscurethe inventive aspect. For example, while only a single machine isillustrated, the term “machine” shall also be taken to include anycollection of machines that individually or jointly execute a set (ormultiple sets) of instructions to perform any one or more of themethodologies discussed herein.

Additional Embodiments

Thus, one embodiment of each of the methods described herein is in theform of a computer-readable carrier medium carrying a set ofinstructions, e.g., a computer program that are for execution on one ormore processors. Thus, as will be appreciated by those skilled in theart, embodiments of the present invention may be embodied as a method,an apparatus such as a special purpose apparatus, an apparatus such as adata processing system, or a computer-readable carrier medium. Thecomputer-readable carrier medium carries computer readable codeincluding a set of instructions that when executed on one or moreprocessors cause a processor or processors to implement a method.Accordingly, aspects of the present invention may take the form of amethod, an entirely hardware embodiment, an entirely software embodimentor an embodiment combining software and hardware aspects. Furthermore,the present invention may take the form of carrier medium (e.g., acomputer program product on a computer-readable storage medium) carryingcomputer-readable program code embodied in the medium.

Carrier Medium:

The software may further be transmitted or received over a network via anetwork interface device. While the carrier medium is shown in anexample embodiment to be a single medium, the term “carrier medium”should be taken to include a single medium or multiple media (e.g., acentralized or distributed database, and/or associated caches andservers) that store the one or more sets of instructions. The term“carrier medium” shall also be taken to include any medium that iscapable of storing, encoding or carrying a set of instructions forexecution by one or more of the processors and that cause the one ormore processors to perform any one or more of the methodologies of thepresent invention. A carrier medium may take many forms, including butnot limited to, non-volatile media, volatile media, and transmissionmedia.

Implementation:

It will be understood that the steps of methods discussed are performedin one embodiment by an appropriate processor (or processors) of aprocessing (i.e., computer) system executing instructions(computer-readable code) stored in storage. It will also be understoodthat the invention is not limited to any particular implementation orprogramming technique and that the invention may be implemented usingany appropriate techniques for implementing the functionality describedherein. The invention is not limited to any particular programminglanguage or operating system.

Means for Carrying Out a Method or Function

Furthermore, some of the embodiments are described herein as a method orcombination of elements of a method that can be implemented by aprocessor of a processor device, computer system, or by other means ofcarrying out the function. Thus, a processor with the necessaryinstructions for carrying out such a method or element of a method formsa means for carrying out the method or element of a method. Furthermore,an element described herein of an apparatus embodiment is an example ofa means for carrying out the function performed by the element for thepurpose of carrying out the invention.

Connected

Similarly, it is to be noticed that the term connected, when used in theclaims, should not be interpreted as being limitative to directconnections only. Thus, the scope of the expression a device A connectedto a device B should not be limited to devices or systems wherein anoutput of device A is directly connected to an input of device B. Itmeans that there exists a path between an output of A and an input of Bwhich may be a path including other devices or means. “Connected” maymean that two or more elements are either in direct physical orelectrical contact, or that two or more elements are not in directcontact with each other but yet still co-operate or interact with eachother.

Embodiments

Reference throughout this specification to “one embodiment” or “anembodiment” means that a particular feature, structure or characteristicdescribed in connection with the embodiment is included in at least oneembodiment of the present invention. Thus, appearances of the phrases“in one embodiment” or “in an embodiment” in various places throughoutthis specification are not necessarily all referring to the sameembodiment, but may. Furthermore, the particular features, structures orcharacteristics may be combined in any suitable manner, as would beapparent to one of ordinary skill in the art from this disclosure, inone or more embodiments.

Similarly it should be appreciated that in the above description ofexample embodiments of the invention, various features of the inventionare sometimes grouped together in a single embodiment, figure, ordescription thereof for the purpose of streamlining the disclosure andaiding in the understanding of one or more of the various inventiveaspects. This method of disclosure, however, is not to be interpreted asreflecting an intention that the claimed invention requires morefeatures than are expressly recited in each claim. Rather, as thefollowing claims reflect, inventive aspects lie in less than allfeatures of a single foregoing disclosed embodiment. Thus, the claimsfollowing the Detailed Description of Specific Embodiments are herebyexpressly incorporated into this Detailed Description of SpecificEmbodiments, with each claim standing on its own as a separateembodiment of this invention.

Furthermore, while some embodiments described herein include some butnot other features included in other embodiments, combinations offeatures of different embodiments are meant to be within the scope ofthe invention, and form different embodiments, as would be understood bythose in the art. For example, in the following claims, any of theclaimed embodiments can be used in any combination.

Different Instances of Objects

As used herein, unless otherwise specified the use of the ordinaladjectives “first”, “second”, “third”, etc., to describe a commonobject, merely indicate that different instances of like objects arebeing referred to, and are not intended to imply that the objects sodescribed must be in a given sequence, either temporally, spatially, inranking, or in any other manner.

Specific Details

In the description provided herein, numerous specific details are setforth. However, it is understood that embodiments of the invention maybe practiced without these specific details. In other instances,well-known methods, structures and techniques have not been shown indetail in order not to obscure an understanding of this description.

Terminology

In describing the preferred embodiment of the invention illustrated inthe drawings, specific terminology will be resorted to for the sake ofclarity. However, the invention is not intended to be limited to thespecific terms so selected, and it is to be understood that eachspecific term includes all technical equivalents which operate in asimilar manner to accomplish a similar technical purpose. Terms such as“forward”, “rearward”, “radially”, “peripherally”, “upwardly”,“downwardly”, and the like are used as words of convenience to providereference points and are not to be construed as limiting terms.

Comprising and Including

In the claims which follow and in the preceding description of theinvention, except where the context requires otherwise due to expresslanguage or necessary implication, the word “comprise” or variationssuch as “comprises” or “comprising” are used in an inclusive sense, i.e.to specify the presence of the stated features but not to preclude thepresence or addition of further features in various embodiments of theinvention.

Any one of the terms: including or which includes or that includes asused herein is also an open term that also means including at least theelements/features that follow the term, but not excluding others. Thus,including is synonymous with and means comprising.

Scope of Invention

Thus, while there has been described what are believed to be thepreferred embodiments of the invention, those skilled in the art willrecognize that other and further modifications may be made theretowithout departing from the spirit of the invention, and it is intendedto claim all such changes and modifications as fall within the scope ofthe invention. For example, any formulas given above are merelyrepresentative of procedures that may be used. Functionality may beadded or deleted from the block diagrams and operations may beinterchanged among functional blocks. Steps may be added or deleted tomethods described within the scope of the present invention.

Although the invention has been described with reference to specificexamples, it will be appreciated by those skilled in the art that theinvention may be embodied in many other forms.

The invention claimed is:
 1. A method for roadside asset tracking andmaintenance monitoring, the method comprising: periodically deploying avehicle alongside a roadside section, the vehicle comprising: a grasscutter unit controllable to be moveable with respect to the vehicle; atleast one digital camera configured to follow the movement of the grasscutter unit; a data capture device comprising: an asset proximitydetector for detecting the proximity of roadside assets; an asset datacapture device operably coupled to the at least one digital cameraconfigured for capturing roadside asset image data, the asset datacapture device triggered by the asset proximity detector; a globalpositioning system (GPS) receiver; and a data interface forcommunicating with an asset management server, the server comprising anasset tracking register database; receiving the roadside asset imagedata representing images taken of a plurality of roadside assets;receiving location data from the GPS receiver representing therespective locations the roadside assets; utilising an asset type imagerecognition technique for automating the identification of the roadsideassets; comparing roadside asset data of the asset tracking registerdatabase to: record newly identified roadside assets and theirrespective locations in the asset tracking register database; andidentify missing roadside assets.
 2. The method as claimed in claim 1,wherein the asset type image recognition technique comprises an imagerecognition stage comprising edge shape detection.
 3. The method asclaimed in claim 2, wherein the edge shape detection comprises rotationinvariance processing to allow for edge shape detection of skew roadsignassets.
 4. The method as claimed in claim 3, wherein edge shapedetection comprises comparison to reference shapes in a shape referencedatabase.
 5. The method as claimed in claim 1, wherein the imagerecognition comprises an image recognition stage comprising colourdetection.
 6. The method as claimed in claim 5, wherein the colourdetection comprises colour juxtapose detection.
 7. The method as claimedin claim 6, wherein colour detection comprises comparison to referencecolours in a colour reference database.
 8. The method as claimed inclaim 1, wherein the image recognition comprises an image recognitionstage comprising symbol detection.
 9. The method as claimed in claim 8,wherein symbol detection comprises comparison to reference symbols in asymbol reference database.
 10. The method as claimed in claim 8, whereinsymbol detection comprises alphanumeric symbol detection.
 11. The methodas claimed in claim 8, wherein symbol detection comprises textrecognition.
 12. The method as claimed in claim 1, wherein the methodfurther comprises image comparison for detecting roadside asset damageor degradation to identify assets requiring maintenance.
 13. The methodas claimed in claim 12, wherein the image comparison comprises colourcomparison.
 14. The method as claimed in claim 12, wherein the imagecomparison comprises shape comparison.
 15. The method as claimed inclaim 12, wherein the image comparison comprises colour detection. 16.The method as claimed in claim 12, wherein the image comparisoncomprises symbol comparison.
 17. The method as claimed in claim 1,wherein the method further comprises generating a map representationrepresenting the roadside section and the locations of the identifiedroadside assets along the roadside section.
 18. The method as claimed inclaim 17, wherein the vehicle comprises at least one camera forcapturing data from the perspective of the vehicle and wherein the maprepresentation is configured for selectively displaying image data fromthe at least one camera at a plurality of locations along the roadsidesection.
 19. The method as claimed in claim 17, wherein the vehiclecomprises forward and rearward facing cameras for respectively capturingforward and rearward facing image data from the perspective of thevehicle and wherein the map representation is configured for displayingbefore and after maintenance comparison imagery utilising the image datareceived from the forward and rearward facing cameras.